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Method for locating an impact on a surface and device 
therefor 



The present invention relates to the methods for 
5 locating an impact on a surface and to the devices for 
implementing those methods. 

More particularly, the invention concerns a method for 
locating an impact on a surface forming part of an 

10 object forming an acoustic interface, provided with at 
least one acoustic sensor (the object forming an 
acoustic interface may be made of a single piece or of 
several . elements, assembled or at least in mutual 
contact) , a method in which at least one signal is 

15 sensed from acoustic waves generated in the object 
forming an acoustic interface by said impact and the 
impact is located by processing of said sensed signal. 

The document FR-A-2 811 107 describes an example of 
20 such a method that applies in particular to a pane. In 
this known method, the position of the impact on the 
surface of the object is computed by measuring the 
differences in time for the acoustic waves to fly to 
different sensors . 

25 

This known method however requires: 

that the pane used have a perfect homogeneity and 
a perfect surface state, 

that the fields of the pane be specially treated, 
30 particularly to avoid reflections of the acoustic 
waves, 

that the speed of the acoustic waves in the pane 
be known in advance, which assumes a precise knowledge 
of its composition, 
35 - that at least four sensors be used. 



As a result, this known method is particularly costly 
to implement and cannot be applied to any preexisting 
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objects, particularly heterogeneous objects consisting 
of assemblies of pieces, irregular shaped objects, etc. 



The aim of the present invention is in particular to 
5 alleviate these disadvantages. 

For this purpose, according to the invention, a method 
of the type in question is characterized in that it 
comprises a recognition step during which the sensed 

10 signal is compared with at least one predetermined 
signal corresponding to the signal that is sensed when 
an impact is generated on at least one active zone 
forming part of the surface of the object forming an 
acoustic interface (this comparison, which can be made 

15 both in the temporal domain and the frequency domain, 
may where appropriate be made on only one portion of 
the sensed signal or on data extracted from this sensed 
signal after processing, in which case said 
predetermined signal may be reduced to the portion on 

20 which the comparison is made or to the data on which 
the comparison is made) , and the impact is associated 
with said active zone if the sensed signal is 
sufficiently similar to said predetermined signal. 

25 Thanks to these arrangements, a method of locating an 
impact is obtained which is robust, adaptable to all 
objects (including heterogeneous objects consisting of 
assembly of several pieces or of placing several pieces 
in contact) , easy and cheap to apply. 

30 

In preferred embodiments of the invention, one and/or 
other of the following arrangements may also be used 
where appropriate : 

the surface of the object forming an acoustic 
35 interface comprises several active zones and, during 
the recognition step, the sensed signal is compared 
with several predetermined signals each corresponding 
to the sensed signal when an impact is generated on one 
of said active zones; 
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- a single acoustic sensor is used; 

- several acoustic sensors are used and, during the 
recognition step, one signal is sensed for each 
acoustic sensor and the signals sensed by the various 

5 acoustic sensors are compared with the predetermined 
signals independently of one another; 

- the signals sensed by the various acoustic sensors 
are compared with the predetermined signals differently 
from one another; 

10 - several acoustic sensors are used measuring 
several different magnitudes; 

- at most two acoustic sensors are used; 

- the method comprises an initial learning step 
during which each predetermined signal is determined 

15 experimentally by generating at least one impact on 
each active zone; 

each predetermined signal is a theoretical signal 
(computed or determined experimentally on an object 
identical or very similar from the acoustic point of 
20 view to the one used) ; 

during the recognition step, the sensed signal is 
compared with said at least one predetermined signal by 
inter cor relation; 

- during the recognition step, the sensed signal is 
25 compared with said at least one predetermined signal by 

a recognition method chosen from voice recognition, 
signal recognition, shape recognition and recognition 
by neural network; 

- during the recognition step, the sensed signal is 
30 associated either with a single active zone, or with no 

active zone; 

- each active zone is associated with a 
predetermined information element (for example, an 
alphanumeric character, a command, etc.) and, when the 

35 impact is associated with an active zone, an electronic 
device is made to use the predetermined information 
element corresponding to that active zone; 

the surface of the object forming an acoustic 
interface comprises a number n of active zones, n being 
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at least equal to 2, and the recognition step comprises 
the following sub-steps: 

an intercorrelation is made between the sensed 
signal (generally after normalization) and said 
5 predetermined signals Ri{t), i being a natural integer 
lying between 1 and n which designates an active zone, 
and intercorrelation functions Ci(t) are thus obtained, 

a potentially activated active zone j is 
determined which corresponds to the result of 
10 intercorrelation Cj (t) having a maximum amplitude 
greater than those of the other results Ci(t), 

the distribution D(i) of the amplitude maxima of 
the intercorrelation results is also determined: 

D(i) = Max ( (Ci (t) ) , 
15 . the distribution D' (i) of the amplitude maxima of 
the intercorrelation results C'i{t) between Rj (t) and 
the various predetermined signals Ri(t) is also 
determined: 
D' (i)= Max( (C'i(t) ) , 
20 . a determination is made as to whether the impact 
was generated on the active zone j as a function of a 
level of correlation between the distributions D(i) and 
D' (i) ; 

during the recognition step, the sensed signal is 
25 processed in order to extract therefrom the data 
representative of certain characteristics of the sensed 
signal and the data thus extracted is compared with 
reference data extracted from the signal that is sensed 
when an impact is generated on each active zone; 
30 - during the recognition step, a code is determined 
from said data extracted from the sensed signal and 
this code is compared with a table which gives a 
correspondence between at least certain codes and each 
active zone; 

35 - the object forming an acoustic interface comprises 
at least two active zones and, during the recognition 
step, the resemblance values representative of the 
resemblance between the sensed signal and the 
predetermined signals are determined (especially a 
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value derived from the intercorrelation function, for 
example its maximum) , the impact is associated with 
several adjacent active zones corresponding to a 
maximum resemblance, called reference active zones, 
5 then, the position of the impact on the surface is 
determined as a function of the resemblance values 
attributed to the reference active zones; 

the position of the impact on the surface is 
determined such that the resemblance values attributed 
10 to the reference active zones correspond as well as 
possible to theoretical resemblance values computed for 
said reference active zones for an impact generated in 
said position on the surface; 

the theoretical resemblance values are a function 
15 of the position of the impact on the surface, 
determined in advance for each possible set of 
reference active zones; 

the active zone is identified by comparison 
between the phase of the predetermined signals Ri(t) 
20 and of the sensed signal; 

during the learning phase, a computation is made 
of the Fourier transform Ri (©) = | Ri (co) I . e^ of each 

acoustic signal Ri(t) generated by an impact on the 
active zone i, where i is an index lying between 1 and 
25 n, and from this Fourier transform only the phase 
component e^ ^""^^^ is retained, only in the frequency 
bands co in which the amplitude |Ri(co)| is greater than 
a predetermined threshold, then the same process is 
applied to each sensed acoustic signal S{t) during the 
30 normal operation of the device; 

the predetermined threshold is equal to the 
maximum of MAX/D and |B((d) |, where: 

MAX is chosen from the maximal value of the 
modules |Ri(a))|, the maximal value of the modules 
35 |Ri(co)| each normalized in energy, and the maximal 
value of the envelope of the average of the modules 
|Ri(co)| each normalized in energy, 
D is a constant, 

IB (CD) I is the average of several noise spectra in 
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the object forming an acoustic interface, acquired at 

different times; 

during the normal operation of the device: 
a product Pi(cD) is computed equal to S' (co) 
5 multiplied by the conjugate of Ri' ((D) for references 

i = 1 ... n, 

then the products Pi{co) are normalized, 

then the inverse Fourier transform of all the 

products Pi (CO) is carried out and temporal functions 
10 Xi(t) are obtained, 

and the signal S{t) is attributed to an active 

zone (10) as a function of said temporal functions 

Xi(t) ; 

the signal S(t) is attributed to an active zone as 
15 a function of the maximal values of said temporal 
functions Xi(t). 

Furthermore, another aim of the invention is a device 
especially adapted to implement an interfacing method 
20 as defined above- 

Other features and advantages of the invention will 
emerge from the following description of five of its 
embodiments, given as nonlimiting examples, with 
25 respect to the attached drawings. 

In the drawings : 

figure 1 is a schematic view in perspective 
showing an exemplary device comprising an acoustic 
30 interface adapted to implement a method according to a 
first embodiment of the invention, 

figure 2 is a block diagram of the device in 
figure 1, 

figure 3 depicts a graph illustrating an exemplary 
35 method used to associate an impact on the surface of 
the acoustic interface visible in figure 1, with an 
active zone of that surface, 

figure 4 depicts schematically an acoustic 
interface that can be used in a device for implementing 
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a method according to a second embodiment of the 
invention, 

- figure 5 is a block diagram of an exemplary device 
that can use the input interface of figure 4, 

5 - and figures 6 to 9 depict schematically acoustic 
interfaces that can be used in a device for 
implementing a method according to third, fourth and 
fifth embodiments of the invention. 

10 In the various figures, the same references designate 
identical or similar elements. 

Figure 1 depicts a device 1 intended to implement the 
present invention, which comprises for example: 
15 - a microcomputer central processing unit 2, 

- a screen 3 connected to the central processing 
unit 2, 

and an acoustic input interface 4 which is used to 
communicate information to the central processing unit 
20 2 in the example in question. 

The acoustic input interface 4 comprises a solid object 
5, consisting here of a table in which acoustic waves 
are propagated by generating impacts on its surface 9 
25 as will be explained hereafter. 

It will be noted however that the object forming an 
acoustic interface could consist of any other object, 
homogeneous or heterogeneous, made up of a single piece 

30 or of several pieces assembled or simply in mutual 
contact, such as: pane, door, window, a portable tray, 
computer screen, display panel, interactive terminal, 
toy, vehicle dashboard, rear of front seat back of 
automobile vehicle or of airplane seat, wall, floor, 

35 vehicle fenders (the information transmitted by the 
acoustic interface then being the position of an impact 
on the fenders), etc. 

At least one acoustic sensor 6 (only one sensor 6 in 
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the example shown) is attached to the object 5, this 
acoustic sensor 6 being connected for example to the 
microphone input 7 of the central processing unit 2, by 
means of a cable 8 or by any other means of 
5 transmission (radio, infrared or other) , so as to sense 
said acoustic waves and transmit them to the central 
processing unit 2. 

The acoustic sensor 6 may for example be a 
10 piezoelectric sensor or other (for example a capacitive 
sensor, a magnetostrictive sensor, an electromagnetic 
sensor, an acoustic velocimeter, an optical sensor 
[laser interferometer, laser vibrometer, etc.], etc.). 
It may be suitable for measuring for example the 
15 amplitude of the movements due to the propagation of 
the sound waves in the object 5 forming an acoustic 
interface, or the speed or acceleration of such 
movements, or it may involve a pressure sensor 
measuring the pressure variations due to the 
20 propagation of the acoustic waves in the object 5. 

On the external surface 9 of the object 5 (in this 
instance on the upper face of the table forming said 
object 5 in the example shown in figure 1), several 
25 active zones 10 are defined which can be delimited for 
example : 

by a physical marking, removable or not, affixed 
to the surface 9 of the object 5, 

or by a luminous marking obtained by projecting an 
30 image onto the surface 9. 

The surface 9 could also comprise portions in which the 
generation of an impact would be forbidden for example 
by covering them with a material that is "flexible or 
35 simply inaccessible to the user, particularly for 
better reliability of the system. 

The various active zones 10 may simply be portions of 
the surface 9, identical to the rest of the surface 9. 
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These active zones are however differentiated from one 
another and from the rest of the surface 9 to the 
extent that an impact on one of the zones 10 generates 
an acoustic signal different from the signal generated 
5 by an impact on another of the active zones 10 or on 
another portion of the surface 9. 

Each of the active zones 10 is associated with a 
predetermined information element that a user may wish 

10 to communicate to the central processing unit 2. The 
information in question may for example be a command, a 
digit, a letter, a position on the surface 9, or any 
other information that can be habitually transmitted to 
an electronic device such as a microcomputer (or to the 

15 central processing unit of another electronic 
apparatus) by means of the conventional input 
interfaces such as keyboards, control buttons, mice or 
other . 

20 The information in question may, where appropriate, be 
indicated in clear by the markings 10a on the surface 9 
(as for the identifiers of the zones 10, these markings 
may be affixed physically to the surface 9 in a 
permanent or removable manner, or they may be projected 

25 in the form of luminous images onto said surface 9) . 

As a variant, the surface 9 of the object 5 may simply 
comprise identifiers (physically affixed or luminous) 
to distinguish the active zones from one another. These 
30 identifiers may for example be numbers or colors and a 
reminder of their meaning may where necessary be given 
by a display generated by the central processing unit 2 
on the screen 3- 

35 Where necessary, the surface 9 may also comprise no 
marking, either to delimit the active zones, or to 
identify the information to which they correspond, in 
which case the active zones 10 would be known only to 
the authorized users of the device 1. 
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It will be noted that the predetermined information 
elements associated with each active zone 10 may either 
be always the same or vary as a program runs in the 
5 central processing unit 2, or depend on previous 
actuations of other active zones 10 (certain active 
zones 10 may for example be actuated to change the 
function attributed to one or more active zone(s) 10 
actuated after it, so as, for example, to access 
10 specific functions, special characters, or to put 
letters in upper case, etc.). 

The various active zones 10 of the object 5 therefore 
constitute a true virtual keyboard that is actuated by 
15 hitting the active zones with a fingernail, with the 
fingertips, with an object such as a pen, stylet or 
other . 

It will be noted that the surface 9 of the object 5 
20 could, where appropriate, comprise a single active zone 
10 in the simplest cases, this active zone 10 however 
not extending to the whole surface 9 and preferably 
constituting a small portion of said surface 9- 

25 As shown in figure 2, the sensor 6 (SENS.) may 
conventionally be connected via the input 7 to an 
amplifier 11 itself connected to an analog/digital 
converter 12 (A/D) which transmits the received signals 
to the processor 13 of the central processing unit 2 

30 (CPU) which processor is in turn connected to one or 
more memories 14 (MEM.) and commands the abovementioned 
screen 3 (SCR.) or any other output interface sending 
information to the user. 

35 It will be noted that the acoustic interface 4 could 
serve as an interface for inputting information to any 
electronic devices other than a microcomputer, for 
example a domestic or business electronic apparatus, a 
digicode, a vehicle electronic central processing unit. 
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etc. In all cases, the electric signals generated by 
the sensor or sensors 6 may be processed either in this 
electronic apparatus or in an external digital signal 
processing device (DSP) . 

5 

During the use of the device 1 described above, when a 
user generates an impact on the surface 9 of the object 
5, this impact engenders an acoustic wave which is 
propagated in the object 5 to the acoustic sensor 6. 
10 The acoustic sensor 6 then generates an electric signal 
S(t) which, after digitization, is processed by the 
processor 13 (or by another dedicated processor, inside 
or outside the central processing unit 2) . 

15 The processor 13 then compares the received signal with 
the various predetermined signals belonging to a 
library of signals previously stored in the memory 14, 
these predetermined signals corresponding respectively 
to impacts generated on the different active zones 10 

20 of the object 5. 

This comparison is used to ascertain whether the 
acoustic signal originates from one of the active zones 
10, and which, irrespective of the mode of excitation 
25 of said active surface (impact of a fingernail, of a 
fingertip, of the palm of a hand, of an object such as 
a pen or a stylet, etc.). 

* These predetermined signals from the library of signals 
30 may have been determined during an initial learning 
phase in which impacts are generated successively on 
all the active zones 10 of the object 5, by recording 
the corresponding signals (preferably after 

normalization, for example so that the energy of each 
35 reference signal is equal to 1) received in the central 
processing unit 2 via the acoustic sensor 6. 

As a variant, when the object 5 has a simple and/or 
repetitive geometric shape, it is possible for the 
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predetermined signals from the library of signals to be 
obtained by modeling or determined experimentally only 
once for all the objects 5 of a series of identical 
objects: in these two cases, there would therefore not 
5 be a prior learning phase for the particular object 5 
connected to the central processing unit 2, but simply 
installation of the library of signals in the memory 14 
of said central processing unit. 

10 It will be noted that, in some cases (particularly if 
the object 5 is made of wood) , the predetermined 
signals from the library of signals may be made to vary 
according to the ambient conditions, particularly the 
temperature and the humidity. These variations may be 

15 computed or be the result of a new learning phase. 

The signals received during the use of the device 1 can 

be compared with the predetermined signals from the 

library of signals: 
20 - directly on the temporal signals S(t) received 

from the sensor 6, 

or on the frequency spectrum of these signals (for 

example after Fourier transform of the temporal signals 

received from the sensor 6) , 
25 - or on other data characteristic of the signal, 

particularly its phase. 

The sensed signals can be compared with the 
predetermined signals from the library of signals by 
30 any known means, in particular: 
by intercorrelation, 

by known methods of voice recognition, of signal 
recognition or of shape recognition, 
- by the use of neural networks or others. 

35 

As a more precise example, the following method can in 
particular be used to recognize the active zone 10 from 
which the sensed signal S(t) comes: 

(1) after normalization of the sensed signal S(t) (for 
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example S{t) is calibrated so that its energy is equal 
to 1), the signal S(t) generated by the sensor 6 is 
intercorrelated with the n predetermined signals also 
normalized from the library, denoted Ri(t) where 
5 i = l-.n. Functions Ci(t) are thus obtained that are 
the temporal results of the product of intercorrelation 
of the signal S(t) respectively with the signals Ri(t) 
from the library. Based on these computations is 
determined a potentially activated active zone j 
10 corresponds to the result of intercorrelation Cj (t) 
having a maximum amplitude greater than those of the 
other results Ci (t) . 

(2) The distribution D(i) of the amplitude maxima of 
the intercorrelation results is also determined: 

15 D(i) = Max( (Ci (t) ) where i = l..n. 

(3) A second distribution function D' (i) , obtained in 
the same manner as the computation of the function D(i) 
but replacing S(t) with Rj (t) , is computed. 

(4) An intercorrelation is carried out of the 
20 distributions of the amplitude maxima D{i) and D' (i) . 

If the maximal amplitude E of the result of 
intercorrelation between D{i) and D' (i) is sufficient, 
then j is the considered number of the activated zone. 
Otherwise, the signal generated by the sensor 
25 corresponds to a false alarm. 

During this step (4), E and the maximal value of D(i), 
or Max(D(i)) can simply be computed: if these two 
values are considered to be the coordinates of a point 

30 in a two-dimensional space of axes x=Max(D{i)) and y=E, 
as shown in figure 3, a curve threshold L can be 
determined in advance (empirically or by computation) 
which delimits a domain D corresponding to the 
validated points (this domain is finite and limited at 

35 x=l and y=l, absolute maximal values of D(i) and E) . 
The sensed signals which give points outside the domain 
D, for their part, are eliminated as being false 
alarms . 
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In the example in question, the line D is a straight 
line which can pass for example through the points (SI, 
0) and (0, S2) . For example, Sl=0.4 and S2=0 . 4 or 0.6. 

5 It will be noted that in addition to identifying the 
active zone 10 from which the impact comes, it would be 
possible to measure the force of the impact, for 
example in order to guide the user in how to use the 
acoustic interface, or to modulate the action triggered 
10 by an impact on an active zone 10, according to the 
intensity of that impact. 

It will be noted furthermore that the signals 
originating from the active zones 10 may, where 

15 necessary, be recognized by using only a portion of the 
received signals S(t) or a portion of their frequency 
spectrum or more generally a portion of their 
characteristics. In this case, during the recognition 
step, the sensed signal is processed in order to 

20 extract from it data representing certain 
characteristics of the sensed signal and the data thus 
extracted is compared with reference data extracted 
from the signal which is sensed when an impact is 
generated on each active zone. 

25 

Thus, it is for example possible to measure the 
amplitude and the phase of the signal for m 
predetermined frequencies (m being a natural integer at 
least equal to 1) and to compare these measured 

30 amplitudes al-am and these measured phases pl-pn with 
the measured amplitudes Ail-Aim and the measured phases 
Pil-Pim at said predetermined frequencies based on 
signals received during the learning phase (or 
determined by modeling) for the various active zones 10 

35 numbered i (i being between 1 and n, where n is the 
number of active zones 10) . 

As a variant, it is possible to determine a code from 
said data extracted from the sensed signal and to 
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compare this code with a table which gives a 
correspondence between at least certain codes and each 
active zone (the codes contained in this table then 
represent the predetermined signals from the 
5 abovementioned library of signals) . 

As a nonlimiting example^ a 16-bit code can be 
determined from the sensed signal S{t) in the following 
manner : 

10 - the first 8 bits of the code are determined from 
the frequency spectrum of the signal S(t) that is 
subdivided into 8 predetermined frequency tranches [fk^ 
fic+i] / k=1..8: the bit of rank k is equal to 1 for 
example if the final energy value given by the spectrum 

15 at frequency fk+i is greater than the average energy 
value of the acoustic wave in the frequency tranche 
[fkf fk+i] and this bit is 0 otherwise; 

the last 8 bits of the code are determined from 
the temporal signal S(t) that is subdivided into 9 

20 predetermined temporal tranches [tk/ tk+i] f k=1..9: the 
bit of rank k+8 is equal to 1 for example if the 
average value of the signal power during the period 
[tk/ tk+i] is greater than the average value of the 
signal power during the period [tk+if tk+2] ^ k=1..8, and 

25 this bit is 0 otherwise. 



In this particular example^ the codes in the 

correspondence table would be determined during the 

learning phase, by computing as indicated above the 

30 codes that correspond to the signals sensed by the 

acoustic sensor 6 when impacts are generated on the 
different active zones 10. 



Furthermore, as shown in figures 4 and 5, it may be 
35 possible to use two acoustic sensors 6 (SENS.l and 
SENS. 2), particularly when the object 5 has symmetries 
such that there may be a risk of confusion between the 
signals originating from two different active zones 10. 
Where appropriate, more than two acoustic sensors 6 may 
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be used, although the preferred solutions call for one 
or two sensors 6. 

When two or more sensors are used, two choices are 
5 possible: 

1) mixing of the signals of the various sensors and 
processing of the global signal according to the method 
described above, 

2) or, preferably, individual processing of the 
10 signals of the various sensors with the method 

described above and a cross-checking of the results: 
- if the active zones 10 determined from the various 
sensors have identical numbers, then it is determined 
that the zone that received an impact is the latter, 

15 - in the other cases, it is possible either to 
consider the sensed signal to be a false alarm or to 
determine the zone that received an impact for example 
by intercorrelation between the intercorrelation 
functions Ci{t) determined for each sensor or by more 

20 complex means such as neural networks or others. 

It will be noted that the two acoustic sensors may be 
of different types and/or sense different magnitudes 
and/or their signals may be processed differently to 
25 identify the active zones 10 receiving impacts. For 
example, one of the acoustic sensors may be used to 
record the received signal S(t), while the other may be 
used only to determine a temporal difference between 
the arrival of the acoustic wave at the two sensors. 

30 

The second sensor might furthermore not sense the 
acoustic wave propagated in the solid object 5, but the 
acoustic wave propagated in the air at the time of the 
impact - 

35 

As shown in figure 6, the object forming an acoustic 
interface may consist of the computer screen 3 or a 
television screen to which the sensor 6 is attached. 
The surface receiving the impacts may advantageously be 
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the pane 15 of the screen, which could in particular be 
used to have the screen 3 display the delimitation of 
the active zones 10 and their meaning. This variant 
could be used for example to program a video cassette 
5 recorder, particularly when the screen 3 is a 
television screen (the central processing unit 2 would 
then be replaced by the video cassette recorder) . 

As shown in figure 1 , the object forming an acoustic 
10 interface may also consist of a glass paneled door 16 
or similar. In the example shown in figure 1, the 
surface 17 which supports the active zones 10 consists 
of the glazed surface of the door, and, still in the 
particular example shown in this figure, the acoustic 
15 sensor 6 is attached to a wooden portion of the door 
16. 

In the example shown in figure 8, the object forming an 
acoustic interface is a tray 18 designed especially to 
20 serve as an acoustic interface. This tray may for 
example comprise a rigid frame 19 secured to a base 20, 
also rigid, which supports the acoustic sensor 6. 

A flexible membrane 22, made for example of elastomer, 
25 is stretched over the frame 19 a short distance above 
the base 21. This flexible membrane 22 is provided with 
rigid protrusions 23 under its bottom face (these may 
for" example be glass hemispheres that are bonded 
beneath the membrane 22). Thus, when a user taps on the 
30 membrane 22 and particularly on an active zone 10 
supported by this membrane, this action generates an 
impact of at least one protrusion 23 on the bottom 21 
of the frame of the tray 18. This variant has the 
advantage of producing impacts that are less dependent 
35 on the manner in which the user taps on the membrane 22 
(with the finger or the nail or a tool, with more or 
less force, etc.). 

In the embodiments in figures 6 to 8, the method 
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implemented may be identical or similar to that 
described previously and may be used to provide a 
correspondence of an impact generated on the surface of 
the object forming an acoustic interface either with an 
5 active zone 10 or with no active zone. 

But it is also possible, in all the embodiments of the 
invention using several active surfaces (point-like 
where necessary) , to determine the position of the 

10 impact on the surface 9 of the object 5 forming an 
acoustic interface (see the example in figure 9), even 
when that impact is not on one of the active zones. A 
continuous or pseudo continuous acoustic interface is 
thus obtained (making possible an operation similar for 

15 example to a computer mouse, to a light pen, to a 
touch-sensitive screen or similar) . 

In this case, during the recognition step: 

resemblance values representative of the 

20 resemblance between the sensed signal and the 
predetermined signals are determined (particularly 
values originating from the abovementioned 
intercorrelation functions Ci(t), for example their 
maxima D(i) defined above), 

25 - the impact is associated with a number p at least 
equal to 2 of adjacent active zones corresponding to a 
maximum resemblance, called reference active zones Rl- 
R4 (p may advantageously be 4 particularly for 
positioning the impact according to two dimensions x, 

30 y, or where appropriate less than 4 particularly if the 
impact is to be positioned only according to a single 
dimension x or y) : for example, the zone Rl can first 
be determined as being the active zone 10 having the 
maximal resemblance value D(i), and then, from the 

35 active zones adjacent to Rl, the three zones R2-R4 can 
be determined which give the highest values of the 
resemblance value D(i)); 

then the position of the impact I on the surface 9 
is determined as a function of the resemblance values 
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D(i) attributed to the reference active zones R1-R4 . 

During this last step, advantageously it is possible to 
determine the position of the impact on the surface 
5 such that the resemblance values attributed to the 
reference active zones correspond as well as possible 
to theoretical resemblance values computed for said 
reference active zones for an impact generated in said 
position on the surface. 

10 

These theoretical resemblance values may in particular 
be functions of the position of the impact on the 
surface, determined in advance for each possible set of 
reference active zones. 

15 

The functions in question may be determined during the 
learning step, for example by adjusting a typical 
function on the values of resemblance between the 
active zones. The typical function in question may 
20 depend on the shape of the object and be determined in 
advance, either theoretically or experimentally. 

To take a practical example, the function of 
theoretical resemblance Rth(X,Y) between two points X, 

25 Y of the surface 9 may correspond to the maximum of the 
function of intercorrelation between the signals Sx(t) 
and Sy(t) sensed by the sensor 6 respectively when 
impacts are generated at these two points X, Y, and 
this function may for example be of the type Rth(X, 

30 Y) = (sin (a (p) . d) ) / (a(p).d), approximated for example 
by Rth(X, Y) =1- [a (P) .d] V6, where: 
- d is the distance between X and Y, 

P is an angle between for example the x axis (or y 
axis) and the direction X-Y, 

35 - and a(P) is a coefficient dependent on the angle P 
according to an elliptical function: 
a(p)=al.cos(p+p0)+a2.sin( (P+PO) , 

where PO is an angle representative of the orientation 
of the ellipse. 
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The Rth function can be determined for each possible 
set of active reference zones R1-R4, from predetermined 
signals Ri{t) from the library of signals, sensed by 
5 generating impacts respectively on the reference active 
zones during the learning phase - 

Accordingly, for a given set of four reference zones 
R1-R4, the maximum intercorrelation function of the 

10 signal Rl (t) corresponding to Rl can be computed, with 
each of the signals R2(t), R3(t), R4 (t) corresponding 
to the zones R2-R4 . From this are deduced the values of 
al, a2 and PO. The same process can then be performed 
from the reference zones R2, R3 and R4, which on each 

15 occasion gives the values of al, a2 and pO, then the 
average of the four values thus found respectively for 
al, a2 and po can be averaged: these averaged values 
then determine the function Rth for all the reference 
zones R1-R4 . As a variant, the function Rth could be 

20 determined by an iterative optimization process (of the 
least squares method type) to minimize a function of 
error between the function of theoretical resemblance 
and the maxima of the functions of intercorrelation 
between the signals Rl (t) , R2 (t) , R3(t) and R4 (t) taken 

25 two at a time. 

When the abovementioned theoretical resemblance 
functions Rth have been determined, when seeking to 
determine the position of an impact I between four 

30 adjacent active zones R1-R4 (advantageously point- 
like) , this position can for example be determined by 
an iterative optimization process by minimizing a 
function of error between the values D(i) previously 
defined (D (i) =Max (Ci ( t ) ) , with i here being the number 

35 of the reference active zone Ri in question) and the 
values of theoretical resemblance Rth (I, Ri) . For 
example, a function of error E equal to the sum of the 
values (D(i)-Rth(I, Ri))^ can be minimized. 
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The method that has just been described is of course 
not limited to the examples that have just been 
described; it has many applications, amongst which: 

the use of panes or other surfaces as an input 
5 interface 4, in shops, museums, art galleries, or other 
places to allow the clients or the visitors to display 
details on a screen or via a loudspeaker concerning the 
products or works exhibited, 

the use of panes or other surfaces of display 

10 panels as input interfaces 4, allowing passers-by to 
display for example details on the publicity items 
being displayed, or to display general information 
concerning a community or another place (for example 
news or practical information, for example a plan of 

15 the location) , or other, these details or information 
being displayed for example on a screen visible in the 
lower portion of the display panel, 

the use of portions of walls, of the ground, or of 
any other object as an input interface 4 for example 

20 for controlling home automation systems (residents of 
an apartment can thus in particular themselves 
determine the positions of the switches, consisting 
simply of the abovementioned active zones 10, 
positioned on the walls or other places as required) , 

25 ~ the use of portions of walls, of the ground, or of 
any other object as an input interface 4 for example 
for controlling industrial machines particularly in 
dangerous environments (places containing explosives, 
places with high temperature, places with high 

30 radioactivity, etc.)f 

- the use of smooth and easily maintained surfaces 
as an input interface 4, in order to constitute input 
keyboards of domestic objects such as refrigerators, 
washing machines or other, 

35 - the use of panels on building doors as input 
interfaces 4, forming for example virtual digicode 
keyboards, 

the use of the ground to locate the position of a 
person walking on it. 
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the production of keyboards or control panels 
unaffected by pollution, bad weather or other external 
attacks, in industrial, military or even domestic 
applications (the acoustic sensor or sensors may where 
5 necessary be fully integrated into the object serving 
as the input interface, in particular if it is an 
object at least partially molded in plastic material); 
when these input interfaces are to control a device 
(for example a microcomputer), comprising a display 
10 screen, the keyboard or acoustic control panel may 
consist of the screen itself or a transparent surface 
covering that screen, 

the production of input interfaces in automobiles 
or other vehicles. 

15 

It will furthermore be noted that the previously 
described input interface 4 could be provided with 
processing means for locally performing the recognition 
of acoustic signals S{t) originating from the active 

20 zones 10, the input interface 4 then sending directly 
to the central processing unit 2, or to any other user 
electronic apparatus, only coded signals indicating 
directly which active zone 10 has been touched by the 
user and, where appropriate, information relating to 

25 the impact: force of the impact and nature of the 
impact . 

It will be noted that the method according to the 
invention does not require the object 5 to have a 

30 homogeneous or predetermined structure, or be made with 
a particular care, or be made with very precise 
dimensions, or with specific surface states. On the 
contrary, the more the object 5 is heterogeneous and/or 
irregular, the more the acoustic signals emitted by the 

35 different active zones 10 will be different from one 
another and the better the acoustic signals will be 
recognized. In certain cases, heterogeneities can even 
be intentionally created such as cavities or others in 
the object 5 to facilitate recognition of the acoustic 
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signals originating from the active zones 10. 

Furthermore, when the predetermined signals from the 
library of signals are determined during a learning 
5 phase, it is possible to use a piezoelectric sensor 
connected by any known means to a central processing 
unit 2 and fixed either to the finger of the user, or 
to the object (stylet or other) used to generate 
impacts on the active zones of the object 5. In this 

10 case^ the impulse signal generated by the piezoelectric 
sensor at the time of each impact can be used to 
trigger the acquisition of the predetermined acoustic 
signal intended to feed the library of signals, and/or 
can be used to measure the intensity of the impact, 

15 this measurement of intensity being able to be used for 
example to invalidate certain acquisitions of 
predetermined signals in particular when the intensity 
is below a predetermined threshold or when this 
intensity does not fall within a predefined period. 

20 

Furthermore, when the predetermined signals from the 
library of signals are determined during a learning 
phase, it may be advantageous to retain only the sensed 
acoustic signals whose amplitude is greater than a 

25 relatively high first reference threshold. In this 
case, during the normal operation of the device, 
account can thereafter be taken of the acoustic signals 
whose amplitude exceeds a second predetermined 
threshold clearly lower than the first threshold. The 

30 first predetermined threshold may thus be equal to 
several times (at least two to three times) the average 
temporal value of the absolute amplitude of the ambient 
noise, measured for example over several seconds, 
whereas the second predetermined threshold may for 

35 example be equal to 1.5 times that average value. In 
this manner, only good quality reference signals are 
recorded during the learning phase, while retaining a 
great sensitivity of the device during its normal 
operation . 
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Where appropriate, the central processing unit 2 may be 
provided with an auxiliary programming keyboard (not 
shown) which may be used in particular during the 
5 learning phase to indicate for example what type of 
signal is generated. This type of generated signal may 
in particular be one of the following types: 

new signal replacing one of the reference signals 
from the library of signals (the identification of the 
10 replaced reference signal may thus be communicated to 
the central processing unit 2 by means of the auxiliary 
keyboard) , 

new reference signal (either for a preexisting but 
incomplete reference library, or for a new reference 
15 library corresponding in particular to new conditions 
of temperature, humidity or state of the object 5) , 

new signal intended to verify a reference signal 
that already exists in a library of signals. 

20 Furthermore, when the predetermined signals from the 
library of signals are determined during a learning 
phase, provision may be made where appropriate to 
validate the reference signals from that library only 
when they are confirmed by generation of one or more 

25 impact (s) on the same active zone, within a 
predetermined elapsed time following the generation of 
a first impact. 

When the predetermined signals from the library of 
30 signals are determined during a learning phase, the 

impacts generated on the object 5 during this learning 

phase may be generated: 

either with a hard object such as a stylet, in 

which case the same stylet will preferably be used 
35 during the normal operation of the device, 

or with a more shock-absorbent object such as for 

example a hard plastic rubber attached to the end of . a 

pen or similar (the inventors have thus been able to 

obtain good results with a ^^Staedler" brand of hard 
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plastic rubber for transparencies) , in which case the 
impacts on the object 5 may then be generated just as 
well with relatively hard objects as with less hard 
objects (fingernail, finger pad or other) during the 
5 normal operation of the device. 

Furthermore, as a variant of the method previously 
described to recognize the active zone 10 from which 
the sensed signal S(t) comes, it is possible to use the 
10 following method: 

(1) during the learning phase, the Fourier transform 
Ri(co) is computed for each acoustic signal Ri(t) 
generated by an impact on the active, zone i, where i is 
an index lying between 1 and n: 

15 Ri(G)) = I Ri(0)) I .e=* 

From this Fourier transform, only the phase component 
is retained, only in the frequency bands co in which the 
amplitude of the spectrum is greater than a 
20 predetermined threshold. 

The frequency shape of the reference signal retained is 
therefore expressed in the form R'i(co) = ^'-^^^ for the 
frequencies co at which |Ri((o)| is greater than the 
25 predetermined threshold and R'i(co) = 0 at the other 
frequencies co. 

The predetermined threshold in question may for example 
be equal to the maximum of MAX/D and of |B(co) |, where: 

30 - MAX may be either the maximal value of |Ri(co)|, or 
the maximal value of the modules |Ri(co)| each 
normalized in energy, or the maximal value of the 
envelope of the average of the modules |Ri(co)| each 
normalized in energy, 

35 - D is a constant, for example equal to 100, 

|B{co) I is the average of several noise spectra in 
the object 5, acquired at different times. 

(2) During the normal operation of the device, each 
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sensed signal S(t) undergoes the same process as in 
step (1) above, such that a signal S' {(o) = e^^^®^ is 
obtained for the frequencies co at which |S(a))| is 
greater than the abovementioned predetermined 
5 threshold, S' (co) being equal to 0 at the other 
frequencies . 

(3) Then a product Pi (co) is computed equal to S' (co) 
multiplied by the conjugate of R' (co) for i == 1 ...n. 

10 

(4) The products Pi(co) are normalized by dividing them 
by their integrals. 

(5) Then the inverse Fourier transform of all the 
15 products Pi (CO) is carried out and temporal functions 

Xi(t) are obtained. 

According to the different functions Xi(t), and 
particularly according to their maximum, the signal 

20 S(t) can then be attributed to one of the active zones 
10. As an example, the maximal value (as a relative 
value or absolute value) can be computed of the 
different functions Xi(t) and the signal S(t) can be 
attributed to the active zone i which corresponds to 

25 the function Xi(t) with the greatest maximum. Where 
necessary, the maximum of the function Xi(t) retained 
can also be compared with a threshold defined in 
advance, for example equal to 0.6, and it can be 
decided that the signal S(t) should be attributed to 

30 the zone i when the maximum of Xi(t) is greater than 
this threshold (if several functions Xi(t) have their 
maximum greater than 0.6, only the function Xi(t) with 
the greatest maximum is then retained) . 

35 It is possible where necessary to verify that the 
attribution of the signal S(t) to the active zone i is 
correct, for example by computing a value MMi = M±/M 
where Mi is the maximum of the absolute value of Xi(t) 
and M is the average value of all the values Mi. The 
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attribution of the signal S(t) to the active zone i may 
then be considered to be correct if that value MMi is 
greater than a certain limit, equal for example to 
1.414 . 

5 

It will also be noted that the abovementioned values 
MMi Tday be computed by replacing S' (co) with R'iCco), in 
order to obtain information on the spatial resolution 
of the active zones. In particular, it can thus be 
10 verified that an active zone with index i does not risk 
being confused with another, by verifying that the 
corresponding value MMi is greater than a predetermined 
limit, for example greater than 1.414. 

15 Furthermore, it is also possible to take account of 
different environmental parameters (temperature, 
relative humidity, mechanical stresses, etc.) by 
modifying the predetermined signals from the library of 
signals as a function of the environmental parameter or 

20 parameters. 

Accordingly, use can be made of one of the following 

correction methods: 

linear temporal dilation or contraction of the 
25 reference signals from the library of signals: in this 

case, the reference signals Ri(t) from the library of 

signals are replaced by signals Ri(at), where a is a 

non null positive multiplier coefficient which is a 

function of the environmental parameters, this 
30 coefficient a being able to be determined theoretically 

or experimentally for a given material, or 

experimentally for each object 5; 

linear temporal dilation or contraction of the 

sensed signals S{t): in this case, the reference 
35 signals Ri(t) are left unchanged, but the sensed signal 

S(t) is replaced by S(at) where a is a coefficient as 

defined above; 

- nonlinear dilation or contraction in frequency of 
the reference signals: in this case, the frequency 
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signals R'i(co) are replaced by R'i{co'), with 
Q)' — , ' where cDn is equal to half the 

sampling frequency of the processing device, and P is a 
coefficient determined theoretically or experimentally; 
5 - nonlinear dilation or contraction in frequency of 
the sensed signal S{t): in this case, the reference 
signals from the library of signals are left unchanged, 
and the signal S' (co) is replaced by S' (co' ) , co' being 
defined above. 

10 

In the two abovementioned cases of nonlinear dilation 
or contraction in frequency, it is possible also to use 
an averaged correction of phase, in which case the 
signals Ri(co') are replaced by Ri((D'). MMco) /N' (co) or 
15 the signals S(co') are replaced by S(a)'). M' (co) /N' (co) . 
In one or other of these formulae, N' (co) =M (co) / | M (co) | , 
and N'' (co) =N (to) / I N (co) I , M(co) being equal to the average 
of all the Ri(co) and N(co) being equal to the average of 
all the Ri (co' ) . 

20 

The various abovementioned corrections of the reference 
signals Ri(co) or of the sensed signal S (co) may be made 
either automatically by the central processing unit 2, 
particularly as a function of information given by one 
25 or more sensors (not shown), or manually by the user. 

Furthermore, it will be noted that the central 
processing unit 2 may comprise several libraries of 
reference signals suitable for different values of the 
30 environmental parameters. 

Furthermore, to suit the types of impacts generated 
when the device is used, and particularly to suit the 
use either of a finger of the user, or of another 
35 object to generate the impacts, it may be advantageous 
to request the user to generate impacts on one or more 
predetermined active zones 10, for example two active 
zones of indices m and p. Thus two temporal signals 
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Sm(t) and Sp(t) are sensed^ their Fourier transforms 
Sm(co) and Sp{0)) are computed and then the average MiCco) 
of the following two terms is computed: 

(Rm{CD) . |Sm((0) I )/( |Rm((0) I .Sja{(0) ) , 

5 - and (Rp (co) . I Sp (©) I ) / ( I Rp (03) I . Sp (co) ) . 

This average Mi(co) is then used in step (3) previously 
defined to replace the product Pi{co) with Mi (co) . Pi (co) , 
this product then being used instead of Pi((o) in step 
10 (4). 

Furthermore, it will be noted that the invention allows 
a user to define active zones at will and the central 
processing unit 2 may be suitable for keeping active 
15 this definition of the active zones only when the 
object 5 is effectively being used as an acoustic 
interface. In this case, the abovementioned definition 
of the active zones is erased by the central processing 
unit 2 after a certain period of nonuse of the device. 

20 

It will also be noted that the function generated by an 
impact on an active zone may be modulated where 
appropriate as a function of the intensity of that 
impact . 

25 

It will also be noted that, when the object 5 exhibits 
resonance phenomena which cause prolonged propagations 
of acoustic waves on each impact on the active zones, 
it may be advantageous to raise the threshold of 

30 detection of the acoustic signals S(t) (for example up 
to 0.5 times the maximal value admissible by the 
electronic system for acquisition of the signal S(t)) 
when a signal S(t) has been detected, then to lower 
this detection threshold again (notably in exponential 

35 manner) to its normal level: thus, multiple detections 
of one and the same impact are avoided. 

It will be noted that, in all the embodiments of the 
invention, it would where necessary be possible to 
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define a single active zone on the object 5, in which 
case it is nevertheless possible to code several 
functions on that single active zone, for example 
according to the number of impacts generated 
5 consecutively on the same zone. 

Furthermore, the active zones 10 may where necessary 
not be defined in advance, but simply be defined as a 
function of the successive impacts received during the 

10 use of the device. Thus, the device can for example be 
designed to comprise three active zones, which are each 
simply defined on the receipt of a first impact on each 
zone, and which are then recognized as ''first zone'', 
^'second zone", and ''third zone", on receipt of the 

15 subsequent impacts. 

Furthermore, when the active zones are very numerous, 
use can be made where necessary of an automated device 
to generate the reference signals stored in the library 

20 of signals during the learning phase. This automated 
device could for example comprise a system of movement 
on two dimensions, comprising two step motors, to move 
for example an excitation stylet or similar to the 
surface of the object 5 and to generate impacts by 

25 means of this stylet, actuated for example by a 
solenoid, on the various active zones - 

Still in the situation where the active zones 10 are 
extremely numerous, it may be possible to divide them 

30 into several resemblance groups. In this case, during 
normal use of the device, when an impact generates a 
signal S(t), a first process is used to attach this 
signal S(t) to one of the resemblance groups, then a 
refined process is used to assign this signal S(t) to 

35 one of the active zones in this resemblance group. 



It will also be noted that the same central processing 
unit 2 could where necessary process the signals 
originating from several objects 5. In addition, it is 
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also possible to interface the acoustic sensor or 
sensors directly with a network, particularly an IP 
network, in order to direct the sensed signals to a 
single IP address from which these signals can be 
5 exploited by any computer connected to the IP network. 



